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Parc 1 
(NAG3-L723) 

MULTI-OBJECTIVE CONTROLLER DESIGN FOR LINEAR SYSTEMS VIA OPTIMAL 

INTERPOLATION 

SUMMARY 

We propose a methodology for the design of a controller which satisfies a set of closed-loop 
objectives simultaneously. The set of objectives consists of (i) pole placement, (ii) decoupled 
command tracking of step inputs at steady-state, and (iii) minimization of step response 
transients with respect to envelope specifications. We first obtain a characterization of all 
controllers placing the closed-loop poles in a prescribed region of the complex plane. In this 
characterization, the free parameter matrix Q(s) is to be determined to attain objectives (ii) 
and (iii). Objective (ii) is expressed as determining a Pareto optimal solution to a vector 
valued optimization problem. The solution of this problem is obtained by transforming it 
to a scalar convex optimization problem. This solution determines Q( 0) and the remaining 
freedom in choosing Q(s) is used to satisfy objective (iii). We write Q(s) = (1/t /(•))$(•) for 
a prescribed polynomial v(s). Q(s) is a polynomial matrix which is arbitrary except that 
Q(0) and the order of Q(s) axe fixed. Obeying these constraints Q{s) is now to be “shaped” 
to minimize the step response characteristics of specific input/output pairs according to the 
maximum envelope violations. This problem is expressed as a vector valued optimization 
problem using the concept of Pareto optimality. We then investigate a scalar optimization 
problem associated with this vector valued problem and show that it is convex. 

The organization of the report is as follows. The next section includes some definitions 
and preliminary lemmas. We then give the problem statement which is followed by a section 
including a detailed development of the design procedure. We then consider an aircraft 
control example. The last section gives some concluding remarks. The Appendix includes 
the proofs of technical lemmas, printouts of computer programs, and figures. 
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PRELIMINARIES 


We first give some definitions: 71 denotes the set of real numbers, 71+ denotes the set 
of nonnegative real numbers, and H denotes the set of proper rational functions with real 
coefficients. The transpose of a matrix E is denoted by E'. If E is a m x n matrix with 
entries over a set R, we sometimes denote this by £ € R mxn or simply by E 6 R, when 
the size of E is irrelevant or clear from the context. For a matrix E over TZ, ||E|| denotes 
the euclidean norm of E } i.e., ||£|| = yJtrace(E'E). I and 0 denote the identity and zero 
matrices, respectively. For a given set R and matrices A = [a tJ ] € R mxn and B = [6 t; ] G R? xr , 
the product A ® B is called the Kronecker matrix product and is defined as the following 
mp x nr matrix: 

a n B ... a Xn B 
a m \B ... a mn B 

For a transfer matrix G(s) 

minimal 

denotes a minimal state-space realization of C7(s) represented by the dynamical equations: 


A B 
C D 



x = Ax + Bu, y = Cx + Du. 


Conversely, for a dynamical system as in (1), 


A B 
C D 


states that the transfer matrix G(s) satisfies C?(s) = C(sl - A)~ l B + D. For at, a 2 positive 
integers satisfying a 2 > at, ‘ax : a 2 ’ denotes the ordered set of integers ‘{at, ...,a 2 }\ Let Vi 
and v-x be some ordered sets of integers contained in {l,...,m} and {1, ...,n}, respectively. 
Consider A 6 /T”*” for some set R. The notation i4( ul u2 ) defines the submatrix of A 
containing its rows and columns with indices contained in v\ and v 2 , respectively. The 
notation (resp. A( :iOJ )) defines the subset of A containing its rows and columns with 

indices in V\ (resp .to}) and {l,...,n} (resp. t/ 2 ). A function <t > : 7Z mxn —>7lis called 

convex if for any A € [0, 1] and Oj G 7Z mxn , i = 1,2 the following inequality holds 

<£(Aori + (1 - A)a 2 ) < A0(ori) + (1 - A)<£(a 2 ) 
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For z=l, I , consider the (cost) function 4>{K)i : 7Z mxn — ► 71. We say that K * € 7Z mxn is 
Pareto optimal with respect to the criterion 


WO en mxn ) 

if there does not exist K° € 7Z mxn satisfying 


<t>{K°) x <<t>{K*)u .... 

where strict inequality holds for at least one i 6 {1,...,/}. 

We will now give three lemmas concerning the concept of Pareto optimality. Lemma 1 
states that if the cost functions are the euclidean norms of some vector valued functions 
the Pareto optimality is preserved when these cost functions are replaced by their second 
powers. Lemma 2 is concerned with obtaining Pareto optimal solutions via scalarization. 
Lemma 3 states that the notion of Pareto optimality is preserved under one-to-one and onto 
mappings. 


Lemma 1 Consider the functions f(K)i : 7l mxn — 7l kxl , i = 1 A. K m is Pareto optimal 
with respect to 

(ll/Will. 11/00*11: K e K m «") (2) 

if and only if it is Pareto optimal with respect to 


(ll/(A-)ill ! 

Lemma 2 Consider the functions <7>{K)i : 7l m * n — ► 1Z+, i = 1, ..., 
ative numbers otj, i = 1, ..., h. Any solution K * of 


min 


51 oti<fi(I<)i 


h, 


(3) 


and arbitrary nonneg- 


(4) 


is Pareto optimal with respect to 


(0C/C)!, 0(AT) h ; /C € (5) 

Lemma 3 Consider two sets X and y and assume that there exists a one-to-one function 
g from X onto y. Consider a set of given functions 4>(K)i : X — *71, t = and define 
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4>(a)i : y — ► Tl, i = 1, /i as 0(q)< = 0(# H 0 )). where g l (-) denotes the inverse function 
of g(.) from y to X. Then, K* € X is Pareto optimal with respect to 

(0(^Oi> •••> d>(K)h\ K € X) (6) 

if and only if so is g(K*) with respect to 

(0(<*)i ,...,<j>(at)h',oi € y) (7) 


We now give three additional lemmas. Lemma 4 expresses the zero-state unit-step re- 
sponse of a scalar transfer function in terms explicitly of various time functions belonging 
to different components of the transfer function. Lemmas 5 and 6 consider the convexity of 
two particular cost functions. 


Lemma 4 Consider j4(s) € H, B(s) 6 H ixm , Q(s ) € 7i mxn , and C(s) 6 H n * 1 . Assume 
that there exists a polynomial v(s) of order l such that the ( i,j)-th entry ofQ(s), denoted by 
qij(s), can be written as 


qij(s) = -7-r(otij,is‘ + + ... + a, iii0 ), i = 1 , j = 1 , ..., n. 

v{s) 


(8) 


Then, there exists & 6 t a scalar time function a(t), and a set of scalar time 

functions consisting of mn(l + 1) elements, namely 


{/l,o(0. .... /u(t). / 2 . 0 (f), .... / 2 . 1 (f). .... /m„,o(f). fmnAt)}, 


such that the zero-state unit step response associated with the transfer function A(s) + 
B(s)Q(s)C(s) can be written as 


a(t) + <5[/i,o(f) ... / 1 . 1 (f) / 2 . 0 (f) ••• / 2 . 1 (f) •• * /mn, o(f) •• • fmn A l <!)]'■ 


Lemma 5 Consider scalar time functions a(t), bi(t), i = 1, ..., n which are bounded in t > 0. 
For a€'R}* n define a cost function 4>(ot) as follows: 

0(a) = sup{a(t) + a[bi(t ) ... 6„(f)]'}. 

!>0 

The function 0(a) is convex in a. 
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Lemma 6 Consider scalar time functions ai(t), a 2 (t), bi(t), c,(£), i = which are 

bounded in t > 0. For a 6 TZ lxn define the cost function 0(a) as follows: 

0(a) = sup max{aj(f) + a{b x (t) ... 6„(0]', a 2 (t) + afc^t) ... c n (£)]', 0}. 

t> o 

The function 0(a) is convex in a. 

The proofs of the lemmas can be found in Appendix A. 

PROBLEM STATEMENT 

Consider the feedback system in Figure 1 where w\, w 2 are the disturbance inputs and z\, 
z 2 are the regulated outputs. In general, we want to minimize the effect of the disturbances 
on the regulated outputs in the closed-loop system. The output y is the measured output 
and u is the control input. The plant G(s ) and the controller K{s ) are linear time-invariant 
finite dimensional systems. The transfer matrix associated with the input/output pair (u, y ) 
is strictly proper. Let p lt p 2 , rj, and r 2 denote the dimensions of the vectors Zi, z 2 , u/j, 
and w 2 , respectively. For simplicity, we will be concerned with only those plants satisfying 
p x = 7*! = r 2 = 1, p 2 = 2. Our discussion can be extended to more general classes of systems 
in a straightforward way. 

Let a subset V of the left half complex plane be given. This set prescribes the desired 
closed-loop pole locations. V is arbitrary except that it satisfies several assumptions made 
for technical reasons. First, V is symmetric, i.e., if a is contained in V then so is the complex 
conjugate of a. Secondly, we assume that the unobservable and/or uncontrollable modes of 
G(s) around the control channel ( u , y) are all contained in V. Finally, the number of elements 
of V is no less than the order (total number of poles with multiplicities) of the open-loop 
plant G(s) and V contains at least one real element. 

Let K. denote the set of all controllers which satisfy that the closed-loop poles are con- 
tained in V. 

Some arbitrary time functions 

5 f(0, «T(0. *«(0. ««(*), *»(«). *S(0 ( 9 ) 

are given. These functions are defined for t > 0 and are continuous in their domain of 
definition. It is assumed that they satisfy 

s?(t) > s?(t), s%(t) > s^(t), s“(t) > 55(0. Vt > 0 


5 



and 


lim sf'(t) = lira s™{t) = lim 5^(0 = lim sJKt) = lim s^(t) = lim sj^t) = 0 

£—•00 £—00 £—00 £— *oo £—00 £—00 

The functions (9) are called the envelope functions. (See below.) 

We seek for a controller K*(s) which satisfies the following set of design objectives: 

I. Pole placement: We require 

K*{s) € K. 

II. Decoupled command trucking of step inputs at steady-state: Let C 1 (A'(s)] and C 2 (/C(s)] 
denote the closed-loop transfer functions associated with the input/output pairs (u>i, zi) and 
(iu 2 , z 2 ), respectively, and define 

e,{K) = limCi^s)], e 2 (K) = limC 2 [/<:(s)]. 

The controller K*(s) should be Pareto optimal with respect to the criterion 

(||e 1 (/C(5))||, |le 2 ( J ftT(s))||; € /C). 

III. Minimization of step response transients with respect to envelope specifications: Let 
z 2 be partitioned as z 2 = [z 21 z 22 ]'. Consider a fixed but otherwise arbitrary K € 1C. Assume 
that the closed-loop system is initially at rest and apply the following input: 

W\(t) = 1, w 2 (t) = 0, 'it > 0. 

The corresponding response of Z\ is denoted by 

Ci{t) = Z\ (t). 

Now, again assume that the closed-loop system is initially at rest and apply the following 
input: 

u/j(t) = 0, w 2 (t) = 1, V£ > 0. 

Denote the corresponding response of z 2 (t) by 

c 22 (t) = z 2 i(t), c 22 (t) = z 22 (t). 

Note that the functions ci(t), c 2 j(t) and c 22 (t) are bounded in (0, 00 ), due to the fact that 
they are the step responses of stable proper transfer functions. Also notice that ci(t), c 2 i(t) 
and c 22 (t) are functions of K(s); we suppress this for notations! simplicity. 
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We define the maximum envelope violations as follows: 

<P{K(s))i = sup max{ci(i) - s"(t), s?{t) - Cx(t), 0}, (10) 

e>o 

<f>(K(s)) 2l = supmax{c 2 i(0 - S2t(0.®«(0 - c 2 i(t),0}, (11) 

t> 0 

<t>(K(s )) 22 = supmax{c 22 (0 - 5aa(t),«S(0 ~ c 22 (t),0}. (12) 

t> 0 

The cost function in (10) equals the maximum of the deviation of the closed-loop step 
response associated with ( u)\,z \ ) from the region upper and lower bounded by the corre- 
sponding envelope functions. Similar interpretations can be given for the cost functions in 
(11) and (12). 

Let a subset /C of K be given. This set is not arbitrary. We will give a more precise 
description of 1C in the next section. 

Our third objective can now be stated. 

We require K*(s) G 1C and that K*(s) is Pareto optimal with respect to the criterion 

{<KK(s))u 4>{K{s )) 21l <t>(K(s )) 22 ; K(s ) € K). (13) 


AN OPTIMAL INTERPOLATION APPROACH 


Let us first consider how to achieve the objectives I and II. 
Let 


A 

Bx 

b 2 ' 

Cx 

Dx i 

D u 

C 2 

D 2 x 

0 


minima/ 


G(s) 


such that B\ and B 2 have ri and r 2 columns, respectively, and C\ and C 2 have p\ and p 2 
rows, respectively. Let F and H be matrices of suitable dimensions such that the eigenvalues 
of Ap := A + B 2 F and Ah := A + HC 2 are contained in V. Let 


A := 


, S:= 


Af —B 2 F 
o Ah 

Define the following transfer matrices 

A £(:,l:n) 

C {\ D U(l.pi,l.ri) 


Rds) 


Bx 

B\ + H D 2 1 


, R2(S) 




C\ + D l2 F —D\ 2 F 


(14) 


-^ll(pi + l:pi+P5,ri + l:ri+rj) J 


(15) 
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(16) 


Vi(5) 


t/i(s) 


Ap B 2 

[ Cl(l.pw.) + Dl2{l:pi,:)F Di2(l:pl, : ) 

Ap B 2 

[ ^l(Pl+l:pi+W,:) + ^l2(pi + l:pi+p,,:)F .Dl^p+l+Upi+pj,:) 
Ah 5x( ;1 . rl ) + tfZ>21(:,l:rl) 


VM 


(17) 


c% 


'21(:,l:rl) 


. ms) 


Ah •®l(:,rl+l:rl+r2) + # ■f?21(:,rl+l:rl+r2) 
^21(:,pl+l:pl+r2) 

(18) 


Tx(s) 


Ah ~B 2 
F I 


, Ty(s) 


Th(s) 


. ?m(s) 


A# B 2 
C 2 0 

A controller K(s) is an element of K if and only if 


A h -H 
F 0 

A h H 
C 2 I 


(19) 

( 20 ) 


K(s) = (T x (s) - Q(s)T N (s))- l (T Y (s ) - Q(s)T M (s)) (21) 

for some proper rational matrix Q(s) whose poles are contained in V. Moreover, the transfer 
function associated with (zi,tui) is equal to Ri (s) ~h C/i(s)Q(s)Vi(s) and the transfer matrix 
associated with (z 2 ,w 2 ) is equal to R 2 (s) + C/ 2 (s)Q(s)V2(s). 

Objective II can now be more explicitly stated as follows: Determine a proper rational 
matrix Q(s) whose poles are contained in V and <3(0) is Pareto optimal with respect to the 
criterion 


(ll^i(O) + C/i(0)Q(0)Vi(0)||, \\R 2 ( 0 ) + t/2(0)Q(0)V' 2 (0)||; Q(0) e 7Z) (22) 

We attack the problem of determining a Pareto optimal Q(0) by transforming that prob- 
lem to a scalar minimization problem. Note from Lemma 1 that <3(0) is Pareto optimal with 
respect to the criterion (22) if and only if it is Pareto optimal with respect to the criterion 

(ll*»(o) + tfi(o)Q(o)vj(o)|| a , hr 2 (o) + ^(o)<3(o)k 2 (o)|| 2 : <3(o) e iz) (23) 

We solve 

nunaillfliCO) + C/ 1 (0)SV r 1 (0)|| 2 + a 2 ||fl 2 (0) + C/ 2 (0)SV 2 (0)|| 2 (24) 
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for any nonnegative a x and a 2 satisfying a x + a 2 = 1, and let Q(0) = S* where S* is the 
solution of the minimization problem in (24). Defined this way, Q(0) is a Pareto optimal 
solution with respect to the criterion (23) via Lemma 2. 

The reason for dealing with problem (23) rather than (22) is purely technical. The 
removai of the square-root operation speeds up the computation. 

The cost function to be minimized in (24) is convex in S. The solution of (24) can be ob- 
tained via the fminu function of MATLAB. The constants c*i and a 2 in (24) let us give differ- 
ent weightings to the cost functions ||/? 1 (0)+{7 1 (0)Q(0)Vi(0)|| and ||/? 2 (0)+£/ 2 (0)C?(0)V2(0)||. 
We arrive at the following conclusion: 

A controller K(s) satisfies objective II ( together with objective I) if (21) is satisfied for 
some proper rational matrix Q(s) such that the poles ofQ(s) are contained in V and Q( 0) = 
5*. 

It is seen that there is a considerable freedom in designing a controller K(s) to satisfy 
objectives I and II. We will now deal with objective III to make use of this freedom. 

Let us define a subset K, of K as promised in the previous section. Let v(s) be a polynomial 
of order l such that the roots of v(s) are all contained in V. Define 

/C = (A'(s)l K(s) = ( T x (s ) - Q{s)Th(s))~ 1 (T y (s) - Q(s)T M (s)), Q(s ) is proper rational , 
Q(s) = (1 /v(s))Q(s) f or some polynomial matrix Q(s), andQ( 0) = 5’} 

The (i, j)-th entry qi } (s) of Q(s) can be written as in (8). Note that 

<*1,1,0 ••• <*l,n,0 

••• ^m,n,0 

A bijective map between K. and 7Z lxmnl . 

We will now show the existence of a one-to-one function from K. onto iz lxmnl . This 
function will be used to find a Pareto optimal solution with respect to the criteria (13). 
From K. to 

(al) For K(s) € /C, define 

Q(s) = (T x (s)/C(s) - T y (s))(T n (s)K(s) - T M (s))~ l (25) 
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Each entry of Q(s) is in the form of (8) where a tJi0 , i = 1, m, j = 1, n , satisfy 

a l,l,0 ••• a l,n,0 

: : = v(0 )S m (26) 

(a2) Define daj, i = 1, mn, j = 1, ...,/ as in (38). 

(a3) Define a 6 TZ 1XTnnl as 

a = [a u ... a u a 2 ,i ... a 2 ,i ... a mn ,i - a m n.<]- (27) 

From TZ lxmnl to 1C: 

(bl) Represent a € TZ lxmnt as in (27). 

(b2) Obtain a ,j i0 , i = 1, m, j = 1, ..., n to satisfy (26). 

(b3) Define a i = 1, ..., m, j = 1, ..., n, A: = 1, ..., / as in (38) in terms of <5jj, i = 1, ..., mn, 

(b4) Construct Q(s) = ($,•($)] via (8). Q(s) is proper rational, Q(s) = (l/v(s))Q(s) for 
some polynomial matrix $(s), ami <J(0) = 5*. 

(b5) Define K(s) as in (21), which is contained in 1C. 

Let g ( . ) be the map from 1C to a € 7l lxmnl defined via (al)-(a3). It is not difficult to 
show that g ( . ) is one-to-one and onto. The inverse map y -1 ( . ) of g ( . ) is given by (bl)-(b5). 

Let us now obtain equivalent representations of the cost functions in (10)-(12) in terms 
of a parameter over 7£ lxmni . 

Partition R 2 (s) and U 2 (s) as R 2 (s) = [R 2l (s) R 22 (s)]' and U 2 (s) = (f/^(s) U^(s)\'. Then, 
ci(t), c 21 (f), and c 22 (t) are the zero-state unit-step responses associated with the transfer 
functions i?i(s) + tfr(s)Q(s)Vi(s) t Rji(s) + U 2l (s)Q(s)V 2 (s), and R 22 (s) + U 22 (s)Q(s)V 2 (s), 
respectively. 

Write the (i, j)-th entry ^(s) of Q(s) as in (8). Define <5 as in (39). From Lemma 4, 
it follows that there exists scalar valued time functions a^t), i = 1,2,3, and vector valued 
time functions fi(t), i = 1,2, 3, each of dimension 1 x mn(l + 1), such that 

c i(0 = di(t) + <5/i(f), c 2l {t) = a 2 (t) + af 2 (t), c 22 (t) = d 3 (t) + a/ 3 (f), t > 0 (28) 
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From the constructive proof of Lemma 4, one can easily obtain the exact expressions of 
the time functions di(t), and /<(£), i = 1,2,3. Note that 


Q( o) = (i/»(0)) 


Qfi t 0 ••• &mn— m+1,0 


^m,0 ^mn,0 


That is, the elements <5i,o, i G {1, are fixed to satisfy Q( 0) = 5*. Define a vector a 

in H lxmnl according to (27). Observe that a is constructed from a by deleting its entries 
corresponding to &i,o, * G {1, ..., mn}; a represents the free elements of Q(s). 

We then rewrite (28) as 


ci(t) = ai(t) + o/i(t), c 2 i(t) = a 2 (t) + af 2 (t), c 22 (t) = a 3 (f) + a/ 3 (t), t > 0 (29) 

for some scalar time functions dj(f), t = 1,2,3 and vector valued time functions The 

explicit expressions for a t (t ) and /<(£), t = 1,2,3 are omitted. They can be obtained from 
a.(f), and /■(£), i = 1,2, 3 using the definition of a. 

We define the following cost functionals mapping H lxmnl to 7 Z+: 

4>(a) x = <t>{g~ l (a))u 0(a ) 2 1 = <t>(g~ l (a)) 2 u <j>(a) 22 = <f>(g~ l (a)) 22 . 

For K(s) G 1C, 

<KK(s )) i = H9 (K(s))) u 4>(K(s)) 2l = 4>(g(K(s))) 21 , <fi(K(s)) 22 = 4>(g(K(s))) n 


and, via Lemma 3, a controller K(s) is Pareto optimal with respect to (13) if and only if 
g(K(s)) is Pareto optimal with respect to 

(^(a)i J(a) 2 iJ(a) 22 ;ae 7l l * mnl ) (30) 


This transforms the problem of finding a Pareto optimal controller with respect to (13) to 
that of finding a Pareto optimal vector in TZ lxmnl with respect to (30). By Lemma 6, each of 
the cost functionals <p(a) j, 4>{a) 2 \, and <£(a)ja is convex in a. Since the linear combination of 
convex functionals is also convex, for any positive numbers Ai, A 2 , A 3 , satisfying A!+A 2 +A 3 = 
1, the cost functional 

4>(a) := \\4>(a)i + A 2 0(a) 23 + A 3 0(a) 22 (31) 
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is convex in a. The numerical issues concerning how to find a* minimizing (31) are not 
considered in this report. Assuming a numerical procedure is available to obtain such an a*, 
we summarize the design procedure as follows: 

Step 1. Determine the matrices F and H such that the eigenvalues oLA + B 2 F and A + HC 2 
are contained in V. Determine A, B, C, R^s), R 2 (s), U^s), U 2 (s), (s), U 2 (s), T x (s), 

Ty(s), T n (s), T m (s) according to (14)-(20). 

Step 2. Determine the weighting elements a 1 and a 2 according to the design requirements, 
e.g., desired trade-offs between the channels and solve the scalar optimization problem (24) 
for S’. 

Step 3. Obtain the time functions a*(£), /)(£), i = 1,2,3. Determine the weighting elements 
A,, i = 1, 2, 3. Using the result of scalar optimization problem (31) obtain a Pareto optimal 
q with respect to (30). Let a be represented as in (27). 

Ste P 4 - Obtain i = l,...,m, j = l,...,n, from (26) and i = j = 1 ,...,n, 

k = 1, ..., I, from (38), in terms of &ij, i = 1, ..., mn, j = 1, ..., /. 

Step 5. Using a )Jifc construct a stable proper matrix Q(s) = [g<j(s)] according to (8). 

Step 6. Finally, let 

K-(s) = ( T x (s ) - Q(s)T N (s))- l (T y (s) - Q(s)T m (s)). 

K*(s) satisfies objectives I-III simultaneously. 

DESIGN EXAMPLE 

Consider Figure 2. The "System represents the simplified lateral/directional dynamics of a 
very large four-engined passenger aircraft at a particular operating point at high altitude and 
high longitudinal speed. (See Chapter 10.6.5 of McLean, Automatic Flight Control Systems, 
1990). w\ and w 2 are the reference inputs for the yaw rate and bank angle commands, 
respectively. z\ is the yaw rate error, i.e., 

— yaw rate , 

221 is the bank angle error, i.e., 

z 2i = w 2 — bank angle , 
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and 222 is the slip angle. We denote the yaw rate, bank angle, and slip angle by r, 0, and 
7, respectively. The control input u is composed of the aileron and rudder angles (6 a and 
6 r , respectively) and the measured output vector y is composed of r, <p and the roll rate p. 
(p = <j>.) The states of the linear system are r, <j>, p, and 7. 

It is desired to design a controller which yields asymptotic yaw rate command tracking 
and bank angle command tracking for step inputs while the slip angle is isolated from the 
bank angle command at steady state. That is, letting t denote a very small number, the 
transfer matrix from [u/i to [21 2 2 i 2 22 ]' should be equal to 

£ X 
X £ 

X £ 

as s — ♦ 0 where we do not care the entries marked by x. Expressing this design objective 
in terms of standard Hoo or H 2 control problems is difficult because only the (block) main 
diagonal elements of the closed-loop transfer matrix are being minimized. 

We design a controller to achieve objectives I and II. We have developed a computer 
program implementing steps 1 and 2 above (Appendix B). The set of desired closed-loop 
poles is chosen as 

V = {-0.8, -1.9, -1.5 ± 2.7 j, -1.3, -1, -1.7 ± 2.7j}. 

The controller minimizes the magnitudes of the transfer functions associated with the pairs 
(wi.^i). (u>2,z 2 i), and (u/ 2 ,z 22 ) at s 0 = 0 , Si = 2ir/5jrad/s(= 1.256 j rad/s), and s 2 = 
2jt/3 j rad/s(= 2.093 j rad/z). 

We are looking for Q(s 0 ), Q(si), and <?(s 2 ), satisfying that Q(s 0 ) is Pareto optimal with 
respect to 

(IlfMso) + tA(so)Q(so)V' 1 (s 0 )||, \\R*(*o) + U 2 (s 0 )Q(s 0 )V 2 (s 0 )\l Q(s 0 ) € 7 Z), (32) 

Q(si) is Pareto optimal with respect to 

(||rti(si) + tMsi)Q(si)V'i(s 1 )||, ||rt 2 (si) + CMsi)Q(si)V r 2 (*i)||; <?(*) e (33) 

and Q(s 2 ) is Pareto optimal with respect to 

(\\Rx(s 2 ) + t/ 1 (s 2 )Q(s 2 )V' 1 (s 2 )||, ||i? 2 (s 2 ) + £/ 2 (s 2 )Q(s 2 )V' 2 (s 2 )||;Q(s 2 ) € H). (34) 
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We define the scalar optimization problems in (35), (36), (37) associated with (32), (33), 
and (34), respectively: 


+ U i(s)Q(sq)Vi(s 0 )\\ + a 2 \\R 2 (s 0 ) + C7 2 (s 0 )Q(5o)K 2 (5 0 )| (), (35) 


+ £/i(5i)Q(si)K 1 (s 1 )|| + qjIWsx) + a 2 (s 1 )Q(s l )K 2 (s 1 )||) 
<3 ^)| w ( ar| ll^l( 5 2) + £M 5 2)Q(s 2 )Vx(s 2 )|| + a 2 ||-R 2 (s 2 ) + ^2(S2)Q(5 2 )K 2 (S 2 )||) 


(36) 

(37) 

After obtaining minimizing solutions Q*(s 0 ), Q m (si), and Q*(s 2 ) to (35), (36), (37), respec- 
tively (these are Pareto optimal solutions of (32), (33), (34) via Lemma 2), we determine 
a stable rational matrix Q(s) which satisfies (?(s<) = Q*(si), i = 0, 1, 2, and obtain the 
conroller K(s) = (T x (s) - Q(s)Tjv(s))- l (Ty(s) - Q(s)T M (s)). 

Figures 3-14 show the magnitude and phase plots of different controllers which were 
obtained for different Qi, a 2 values. Figures 3-5 correspond to ax = 0, a 2 = 1, figures 6-8 
correspond to ax = 0.1, a 2 = 0.9, figures 9-11 correspond to a x = 0.9, a 2 = 0.1, and figures 


12-14 correspond to ax = 1, a 2 = 0. It is seen that when ax and a 2 are both different than 
zero, it is possible to achieve satisfactory tracking at steady state for both of the channels 
{w\,z\) and {w 2t z 2 ). If ax or a 2 is zero, the corresponding channel has very poor tracking 
performance, due to the fact that no optimization is made with regards to that channel. It is 
also seen that a satisfactory tracking performance cannot be guaranteed for the frequencies 
other than so, si, and s 2 . 

Since no optimization has been made concerning the transient characteristics, the tran- 
sient behavior of the step responses are unsatisfactory. For example, Figure 15 shows the 
step responses of the transfer functions associated with the input/output pairs (u/ 2 , z 2 i) and 
(u/ 2 , z 22 ). The overshoots are extreme for both responses and necessitate the shaping of Q(s) 
for good transient behavior. 


CONCLUDING REMARKS 

We have proposed a method for the design of a controller to achieve multiple closed-loop 
objectives. With this method, it is possible to achieve pole placement and to minimize the 
norms of particularly chosen closed-loop transfer functions at steady state. This method 
offers an alternative to standard and H 2 controller design methods especially for those 
problems where the steady-state decoupling of specific control loops is considered. 
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Although we have shown that the optimization problem (31) is convex, it is yet unclear 
how to solve that problem numerically. One possibility is to use the generic optimization 
programs of MATLAB. Another possibility is to develop a specific optimization algorithm 
tailored to this problem. The computation time may be a possible difficulty. At each 
iteration, the program should compute the value of the cost function. This amounts to 
computing the maximum values of various step responses of the closed-loop system. As the 
order of the Q(s) increases, the number of parameters to be determined will also increase. 
Consequently, the computational difficulties may become more complex. 
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APPENDIX A-PROOFS OF TECHNICAL LEMMAS 

Proof of Lemma 1. We will prove only the [If] part. The [Only If] part can be proven 
similarly. 

Let K * be Pareto optimal with respect to (2). If K * is not Pareto optimal with respect 
to (3) then there exists K° such that ||/(A'°) i || 2 < ||/(A')i|| J for i = 1, where at least 
one of the inequalities, say ||/(/C , )*.ll 2 < II/WaJI 2 , is a strict inequality. This implies 
that ||/(/C’),|| < ||/(A’)i|| for i = 1 with ||/(A’ 0 )fcJ| < ||/(/^)^ 0 || and contradicts the 
fact that K * is Pareto optimal with respect to (2).0 

Proof of Lemma 2. If K * is not Pareto optimal with respect to (5) then there exists K° 
such that 4>{K°)i < , i = 1, .... A where at least one of the inequalities is a strict 

inequality. Since each a < is nonnegative, this implies that < a l <p(K , ) i , i = 

where at least one of the inequalities is a strict inequality. Consequently, 

EMn<E^(n, 

i=i 1=1 

which contradicts the fact that K * is a solution of (4).D 

Proof of Lemma 3. We will prove only the [If] part. The [Only If] part can be proven 
similarly. 

Let K * be Pareto optimal with respect to (6). If g(K *) is not Pareto optimal with respect 
to (7) then there exists q° satisfying < 4>{g{K*)) it i = 1 ,...,h where at least one of 

the inequalities is strict inequality. By the definition, this implies <f>(g~ l (a°))i < <p(K*)i, 
i = 1 , ...» h where at least one of the inequalities is strict inequality. Consequently, there is a 
contradiction. □ 

Proof of Lemma 4. Since B(s)Q(s)C(s) is a scalar, one cam write 

B(s)Q(s)C(s) = (CM ® BM)vec(QM) 

Let 

[di(s) d 2 (s) ... ^(s)] := C'(s) ® B(s) 

We will now define a collection of mn(l + 1) elements in 72.. 

For k € {0, ...,/}, 

a l> = «1,1.*» — - a m,t = a m ,l,k , <5m+l ,k - Ol.J.t. <5 m+ s,fc = a 2 , 2 ,t, a m +3,* = <*3,2,*, .... Sf2 m ,k = a m , 2 ,*, 

<5fnn— m + 1,* “ <*l,n,*, •••> & m n,* = O m , n> *. 

(38) 
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It holds that 


(C'(s) ® B(s)) vec (Q(s)) = £ E 

»=1 jfe=0 U W 

For i € {1, mn}, fc € {0, /}, we let 

, m •= — f°° U u ) kd '(3 u ) eJU,t 
t,k 2n J-oo v(ju>)ju) 

We also define 

a® = -i r ^ )e _ , 

27T J —oo juj 

Then, the zero-state unit step response associated with the transfer function A(s)4-£(s)Q(s)C(s) 
is equal to 

mn / 

a (0 + 5 t, */»,*(*) = °(0 + fi[/l.o(0 ••• /l,/(0 /2,o(0 ••• /2,i(0 ••• fmn,o(t) ■■■ f mn,l( 0] # 

i=l fc=0 

where 

<5 := [<>1,0 ••• Cill,l <*2,0 ,1 ••• ®ran,0 ••• (39) 


This completes the proof. □ 

Proof of Lemma 6. For convenience, define b(t) = [&i(f) ... &„(£)]'. For A € [0,1], ax € 
7Z lxn , and a 2 € 7Z lxn 


<t>(Xct x + (1 - A)q 2 ) = sup f > 0 {a(t) 4- (Aai 4- (1 - A)a 2 )6(f)} 

= sup e > 0 {(A + (1 - A))a(t) + (Aq! 4- (1 - A)a 2 )6(f)} 

= sup t > 0 {A(a(0 + a t 6(t)) + (1 - A)(a(f) + a 2 &(*))} 

< sup t > 0 {A(a(t) 4- a x b(t))} + sup t > 0 {(l - A)(a(t) -I- a 2 b(t))} 

S A sup t > 0 (a(t) + ai6(f)} + (1 - A)sup e > 0 {a(t) 4- a 2 b(t)} 

= A<£(ai) + (1 - A )<t>(a 2 ) 

This completes the proof. □ 

Proof of Lemma 6. For convenience, define b(t) = [6 t (£) ... &„(£)]', c(£) = [c 2 (t) ... c n (f)]'. 

For any a, 

<p(a) = max{sup{ai(f) + a6(t)}, sup{a 2 (£) -l- ac(£)}, 0} (40) 

t>0 t>0 

Consider A € [0, 1], Qj € 72 lxn , and q 2 € TZ lxn . 

Case 1: Assume 0 (Aqx + (1 — A)a 2 ) = 0 

In this case, it is trivial to see that 4>(Xa x 4- (1 - A)a 2 ) < A<^(aj) 4- (1 — A )0(a 2 ). 
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Case 2: Assume 


0(Aai + (1 — A)a 2 ) — sup{ai(t) + (Aari 4- (1 — A)ck 2 )&(t)}. 


t> o 

In this case, Lemma 5 implies 

0(Aori + (1 - A)a 2 ) < A sup{ai(t) + c*i6(£)} + (1 - A) supfa^t) + a 2 i(t)} (41) 

t>0 t>0 

From (40) one can write 

A sup{a x (t) + a x 6(i)} < A0(a x ), (1 - A) sup{a x (f) + a 2 b(t)} < (1 - A)0(a 2 ). (42) 

«>0 e >0 


From (41) and (42), 


0(Aa x + (1 — A)ar2) < A^(ai) + (1 — A)<^(a2). 


Case 3: Assume 


</>(Aq x + (1 - A)a 2 ) = sup{a 2 (t) + (Aa-i + (1 - A)aj)c(f)} 

t>o 


In a similar way to Case 2, it can be shown that 


0(A cn\ + (1 — A)a2) < A0(a x ) + (1 — \)<f>(ci2). 


This completes the proof. □ 
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APPENDIX B-SOFTWARE IMPLEMENTATION 


We describe the software implementation of the steps 1 and 2 of the procedure. 

The system is created in XMATH using SystemBuild. The mathematical model of 
the state-space system is generated in XMATH using the script function parti7.ms. The 
data needed for the optimization problems (35), (36), and (37) is transferred to MAT- 
LAB via an executable program called conv. The source code of conv is a C program 
called col.c. The MATLAB program cono3.m defines various variables to be used with the 
MATLAB programs qlgen.m, q2gen.m, and q3gen.m which solve the convex optimization 
problems (35), (36), and (37), respectively. The MATLAB program interpol3.m deter- 
mines a stable rational matrix Q(s) satisfying Q(s<) = Q*(s,), i = 0,1,2, where Q*(s 0 ), 
<2*(si), and Q‘(s 2 ) are the solutions of (35), (36), (37), respectively. It also converts the 
Q(s) data to a XMATH readable format. The XMATH file oku.ms generates the con- 
troller K(s) = (7a'(s) - Q(s)Tn(s))~ 1 (Ty(s) — Q(s)Tm(s)) based on Q(s). Finally, this 
controller is substituted in a simulation block in SystemBuild and the simulations are per- 
formed. The following pages include the printouts of programs part i7. ms, col.c, cono3.m, 
qlgen.m, q2gen.m, q3gen.m, interpol3.m, oku.ms and the MATLAB subroutines stac.m 
and ogmen.m. 



paxti7.ms 



col . c 



cono3.m 



qlgen . 



q2gen . m 



q3gen. 



interpol3. 



oku. ms 



stac.m 



ogmen . m 
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Figure 2: Closed-loop system of the example. 
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Figure 15: Step responses of the transfer functions from tw 2 to z 2 t (solid line) and z 22 (dashed 
line). In this particular example, the solid line represents the bank angle error and the dashed 
line represents the slip angle error in degrees, (qi = 0, q 2 = 1.) 




Computational Methods for 
Strongly Stabilizing 7i°° Controllers 


Part 2 
(NAG3-1723) 


1 Introduction 

In this report several research directions are described for developing computational methods 
to obtain stable H°° controllers for aircraft dynamics. The proposed techniques are based on 
the results of the Pi’s research performed for the NASA grant no. NAG3-1723. 

Recall that an important motivation behind stable (i.e. strongly stabilizing) controller 
design is reliability against faults in the measurements. Also, from the implementation point 
of view, it is practically impossible to teat an unstable controller in open loop. A necessary and 
sufficient condition for the existence of a strongly stabilizing controller is the parity interlacing 
property (p.i.p.) [1, 2]. There are procedures for constructing stable controllers which stabilize 
a given plant, (3, 1, 2]. But the problem of finding a (sub)optimal one, in the sense of H°°, 
is currently open. Some promising results appear in [4] (see also references therein) on the 
H 2 version of this problem. The effects of weight selection on the stability of the optimal H°° 
controller for SISO plants have been studied in [5]. 

The results of [6], [7] and [8] can be used in order to obtain a parametrization of all subop- 
timal H°° controllers. Most commercially available softwares (e.g. robust control modules of 
MAT LAB and MATRIXx) generate the so-called “central controller” of [7]. This research is 
about finding a stable controller in the parametrization of all suboptimal controllers. For 
a given admissible 7i°° suboptimal performance level the central controller may be unstable, 
but there may be stable controllers in the set of all suboptimal controllers. 

The rest of this report is organized as follows. In the next section stable H°° controller 
design problem is defined and current research findings are summarized. Then, in Section 3 an 
algorithm for interpolation with outer functions is described in connection with stable controller 
design. Another approach, which uses genetic algorithms (GAs), is described in Section 4. The 
search algorithms reported in Sections 3 and 4 are promising research directions determined in 
the project NAG3-1723. This is an ongiong research with a continiuing support from NASA 
Lewis Research Center (under a new grant no. NAG3-1826). 
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Figure 1: Standard Feedback System 

2 Stable 7 i°° controller design 

2.1 Standard problem set-up 

The so-called “standard H°° control problem” deads with the system shown in Figure 1. The 
system equations are assumed to be given by the following 

x(t) = Ax(t) + Biw(t) + B 2 u(t) (1) 

z(t) = Cix(t) + Dnu/(t) + Z?i2u(t) ( 2 ) 

y(t) = C 2 x(t) + D 2l w(t) + D 22 u(t) ( 3 ) 

where x represents combined states (states of the plant and the weights) in the system, and com- 
ponents of w are the exogenous signals (reference inputs, disturbances, measurement noises). 
The optimal H°° problem is to find a feedback controller K (whose input is y and output u) so 
that closed loop system is stable, and the worst energy amplification from w to z is minimized. 
This problem is equivalent to finding a stabilizing controller which minimizes ||T IU ,||oo, where 
T zw (a) is the closed loop transfer function from w to z. The suboptimal H°° control problem 
is to find a stabilizing controller so that ||T zu ,||oo < 7, for a specified performance level 7. 

2.2 Controller formulae 

The formulae of (6, 7 , 8] for H°° controllers, which satisfy a certain specified performance level 
7, is given by 

x c = A c x c + Buy + B 2e q 
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Figure 2 : Suboptimal H°° controllers 

u = C\ c x c + D\\y + £>12? 
r = C 2c x c + &2l y 

where A c , Bu, B2 c,Ci c ,C 2 C , £>n, £>n, £>21 are computed from two algebraic Riccati equations, 
and q(t) is generated by a transfer matrix Q(s), whose input is r(t), with Q € H 00 (that is 
Q must be stable) and ||Q||oo < 7 - Obviously, there are infinitely many choices for Q(s) and 
hence there are infinitely many suboptimal controllers. Implementation of this controller is 
shown in Figure 2 . 

In particular, one can choose Q(s) = 0 , this gives the “central” controller. Note that the 
central controller is stable if and only if A c is a stable matrix (i.e. all the eigenvalues of A c 
have strictly negative real parts). Whereas, stability of a controller which is obtained from a 
non-zero Q(s) depends on A e , B20 C 2c and Q(s). 

2.3 A BMI approach 

Note that if a state space realization of Q is taken as 

X q = AqXq + B q T 
q = CqXq 4 - DqT 
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then the overall H°° controller is 



The H°° controller is stable if and only if 

(i) Ak is stable, i.e. all eigenvalues of Ak are in the open left half plane, and 

(ii) Q(s) parametrizing the controller is stable (i.e. A q is stable), and ||Q||oo < 7- 

These conditions are equivalent to the following. 

(i) Ak is stable if and only if there exists P such that P = P T > 0, and 

A t k P + PA k < 0 

(ii) Q is stable with ||Q||oo < 7 if and only if there exists P q such that P q — Pf > 0, and 

A*P q + P q A q - ( P q B q + C q D q )R~ l (P q B q + CjD q f < 0, where R = D*D q -~, 2 I < 0 
or equivalently 

‘ AlP q + P q A^P q B q Cj ' 

BjP q -I D l < 0. 

C q D q - 7 2 / 

Using these equivalent conditions the following bilinear matrix inequality (5MI) optimiza- 
tion problem can be posed for finding stable H°° controllers: 
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min A 

subject to A t k P + PAk - A/ < 0 
0 < P + XI 

AqPq + PqA q P q B q Cf 

B q P q -I Dj ~ XI < 0 

C, D q -7 2 I 

0 < P q + XI 

0 < A + 1 

If there exists A < 0 the problem is solved. An alternating optimization method is used 
with the LMI (linear matrix inequality) toolbox of MATLAB to search for feasible solutions 
to this optimization problem. Note that for P and P q fixed we have LMIs in the variable 
Q; similarly when Q is fixed we have LMIs in the variables P and P q . A flowchart of the 
proposed search is given above. This algorithm has been tested on numerical examples for 
aircraft control problems (tracking and gust alleviation problems defined in [9]). Depending 
on the realization of the central controller, the algorithm may or may not find a feasible stable 
7t°° controller. Optimal P and P q found from this approach tend to be ill conditioned for the 
numerical examples considered in this study. 
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The BMI optimization method described above tries to find a stable 7i°° controller as 
follows: first some arbitrary positive definite P and P q are chosen, then A is minimized, and 
the corresponding Q is determined, if A < 0 we have a solution. In the next step, for the Q 
found before, we search for P and P q , and check A < 0, if not, for this P and P q find a new 
Q, and iterate until a feasible solution is found. Obviously, there is no guarantee that this 
program will terminate with a feasible solution. A similar method which uses coupled LMIs is 
also proposed in [12]. But their method is also conservative and fails to find a solution for the 
aircarft control problems studied here. 

Solutions to BMI optimization problems are currently investigated by several researchers 
see e.g. [13] [14] and references therein. However, an efficient solution procedure has not been 
found yet. In fact it has been shown that such problems are NP-hard [15], meaning that it 
is rather unlikely to find a polynomial time solution. Hence one is restricted to conservative 
search techniques like the one proposed above. 


3 Interpolation with outer functions 

The structure of Ak given above shows that the H°° controller is stable if and only if Q is a 
stable “controller," with ||Q||oo < 7, stabilizing the “plant” Gc := (A c , B-i Cy C 2 c)- Given Gc, 
all stable controllers Q stabilizing Gc can be parameterized by finding all outer (minimum 
phase) functions satisfying certain interpolation conditions. See [10] and [11] for the details. 
In this research a Matlab based program will be coded to generate this parameterization. Then, 
an optimization will be performed on the free parameter to find a feasible Q, which satisfies 
IIQIIco < 7. 

Key steps to be followed are as below. For simplicity the SISO case is described here, the 
MIMO case will be considered in the actual research. Let pi,... ,pt be the right half plane 
poles of Gc and zi, . . . , z* be the right half plane zeros of Gc- Then, Gc = mnC 0 /m d where 
m n is inner with zeros V s, m d is inner with zeros p/s and C 0 is outer. When Q is stable and 
Q stabilizes Gc we have Sc ■— (1 + GcQ)~ l = rn d S 0 for some outer S 0 such that 

S 0 (zi) = l/m d (zi) t = 
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Once such S 0 is found, we can compute Q as 

q _ ~ ™d 

TTIjiC q 

But for the solution of stable H°° control problem one also needs ||Q||oo < 7- Therefore, the 
problem is reduced to finding an outer function S 0 such that 

(i) S 0 (zi) = l/m<f(zj) for i = 1, . . . , k and 

(ii) ||C- l (5- 1 -m rf )|| 00 < 7 . 

In [10] and [11] the problem of finding 5„ satisfying (i) and having ||S 0 ||oo < P has been studied 
and all solutions are parameterized by appropriately modifying the usual Nevanlinna-Pick 
algorithm. Now, a solution to stable "H 00 control problem can be investigated by: 

Task 1. implementing the above mentioned parameterization for a large p, and 

Task 2. searching for an element which satisfies the condition (ii), from this parameterization. 


4 Genetic algorithms for stable 7i°° controller search 

4.1 General description 

Genetic algortihms (GAs) are a class of heuristic search methods, just like simulated annealing. 
GAs borrow ideas from the mechanisms of evolution and natural genetics. 

Genetic Algorithms are inspired by the natural search and selection processes leading to 
the survival of the fittest individual. They are stochastic search processes directed toward 
increasing the fitness of an individual, and unlike some gradient search techniques which may 
get stuck in local solutions, due to their stochastic nature GAs can locate the globally optimal 
solutions. GAs borrow some terminology from biology to describe the elements of a GA. 
Beginning from the most basic, the elements that make up the setting for GA are: 

• GENE : A gene is a single digit number. Depending on the base in which the numbers 
are described, it is either an element of the set (0, 1, ... ,9} (Decimal representation), or 
the set {0,1} (Binary representation). 
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• CHROMOSOME : A chromosome is a string of genes; 

Ex : 1232378682, 3247866820012, etc. (Decimal rep.) 

1001011010, 101101011011, etc. (Binary rep.) 

Chromosomes are encoded forms of the parameters (matrices, vectors) that the GA is 
searching for. Each single chromosome is a candidate parameter collection, which can 
solve the optimal search problem. 

• TRAIT : A trait is a decimal number. When chromosomes are decoded, each entry of 
the parameter matrices is called a trait. 

• MEMBER : A member(individual) is the object that GA is trying to solve for. It is 
represented by its chromosome. Chromosome determines a member’s traits, which in 
turn determine the member. 

• PARENT : A parent is a member which participates in the creation of a new member. 
(The operations performed to get the new member will be discussed later.) 

• POPULATION : A population is a set of members. During its operation GA works on 
a set of candidates, which are the members of the population. 

• FITNESS : Fitness is the measure of suitableness of the members. To find the optimal 
solution to the search, the objective of GA is to maximize the fitness, i.e. optimal solution 
of the search is the element which is found to have the largest fitness value. 


Coding Scheme :(for decimal representation) 

' B,BjB,9, E,Ej 

♦/. J 


Chromosome : 


trait : (+/-)0. 10 


(+/-) E( Eg 


genes 


The fundamental mechanisms of GA are inspired from the theory of evolution. The three 
fundamental mechanisms are: 
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• CROSSOVER : With a predetermined probability p c two members interchange digits 
from their chromosomes, creating two new members. The idea is to carry the good 
features of some members to the others, and create “fitter” members. Typically p c is a 
large number like 0.85 or 0.9. 

• MUTATION : With a predetermined probability p m the digits of resulting chromosomes 
after crossover are arbitrarily altered. This operation allows creating members with 
totally different characteristics, and is the main mechanism which prevents getting stuck 
at local optimums. Typically p m is chosen to be a small number like 0.2 or 0.25, as we 
don’t want to have a totally random search. 

• ELITISM : This operation carries the fittest member from the previous generation to the 
next generation. It prevents the fittest member from getting lost due to crossover and 
mutation operations. 

Genetic Algorithm Operation : 

The algorithm starts with a population of candidate parameters, which can be totally 
random, or some of which, if available, can be suboptimal previously found solutions to the 
problem. The method requires a fitness function to be chosen, which is to be maximized 
by the desired parameter vector. The members having higher fitnesses get a higher chance 
in participating in the creation of the new generation. While choosing the parents the so 
called “roulette wheel” is used, in which the probability of each member being a parent is 
directly proportional to its fitness. Then evolution mechanisms like crossover and mutation 
are performed on the parents to create new members to the population. If a prespecified fitness 
value is reached, or if the fitness cannot be improved any more the algorithm is terminated; 
otherwise it is repeated over and over by creating new generations. 

4.2 Application of GA to the Strong Stabilization Problem with an %°° 
Performance Constraint 

In Section 2 is shown that the problem of strong stabilization of P with K which will also 
satisfy the H 00 performance constraint has been reduced to the strong stabilization problem of 
C with Q in which Q will have to satisy an H°° norm bound, see Figure 3. For this purpose 
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Figure 3: Parametrization of the controller 

GA is implemented. 

1. Initialize the population; randomly pick Q = (.4,.B,,C„D,)’s. 

2. Make sure that all the Q’s result in stable .4* matrices 

Until achieved, create new Q’s by using the current member (Q leading to the 
unstable A*) and fittest element in the population as parents. 

3. Assign fitnesses to all Q’s (as a function of IQI*,, and A max {.4 k (Q)}) 

If for any Q, |Q|ee < 7. and A fnax {A fe (Q)} < 0 is achieved, then TERMINATE 

4. Compute the new parents which will create the next generation (roulette wheel selection) 

5. Construct the new generation using evolution mechanisms (crossover and mutation) 

Propogate the fittest element directly to the new generation (elitism) 

6. Go to Step 2. 

A search for a constant Q was tried first, i.e. search for £>, only. For small sized Q’s. 
and for the tracking problem, this approach was observed to find a D, matrix, which solves 
the problem. Since we were dealing with a constant Q, we did not need to worry about the 
stability, but only the norm constraint in this approach. 

A search for a dynamic compensator has also been coded, and tried for the same plant. 
Yet, ensuring that .4 k is stable with genetic operators is very time consuming. As inclusion of 


10 






a dynamic compensator significantly enlarges the parameter space, the search becomes much 
more time consuming (yet, it is believed that now the Q’s with the desired properties are 
denser in this space, and thus can be easier to find). 

Recall from the previous section that the strong stabilization problem without the H 00 
performance constraint can also be formulated as an interpolation problem with an outer 
function. This approach may be utilized while initializing the population, or during the effort 
of creating a stable compensator which makes Ak stable, this is Task 1 defined in the previous 
section. A possible approach to accomplish Task 2 is to use the GA serch mechanism outlined 
above. 
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5 Conclusions and Further Research Directions 


Currently there is no single computationally feasible algorithm to find “best” stable 7 i°° con- 
troller. In this project the algorithms proposed above are identified as promising methods to 
find such controllers. However, further research has to be performed in order to evaluate the 
proposed algorithms, and make them numerically efficient. The following specific tasks are 
proposed for further study. 

Task 1. Interpolation with outer functions : 

Write a Matlab based program for parameterizing all outer functions S 0 such that 
S 0 (z,) = I /mrf(zi), t = 1, . . . , k and ||5 0 ||oo < P for some fixed large p. 

Task 2. Genetic algorithms for stable 7i°° controller^ search : 

Incorporate the parameterization implemented in Task 1 into the genetic algorithm which is 
used for finding a stable Q with ||C?||oo < 7, which stabilizes Gc- For an alternative solution, 
write a separate GA code for searching a feasible outer S 0 satisfying 

WCoHSo 1 - m d )||oo < r 

Task 3. BMI_ optimization methods : 

In Section 2 it was demonstrated that the problem of finding a stable 7i°° controller can be 
formulated as a BMI optimization problem. But the BMI optimization problem is shown to 
be NP-hard. Nevertheless, for the special form of the BMIs appearing in stable H°° controller 
design there may be an efficient solution. We also propose to study the structure of BMIs for 
this problem, in particular the effect of different realizations of the central controller will be 
investigated. — 
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